Delay-Guaranteed Cross-Layer Scheduling in 
Multi-Hop Wireless Networks 



Dongyue Xue, Eylem Ekici 



Department of Electrical and Computer Engineering 
Ohio State University, USA 
Email: {xued, ekici} @ece. osu.edu 



Abstract — In this paper, we propose a cross-layer scheduling 
algorithm that achieves a throughput "e-close" to the optimal 
throughput in multi-hop wireless networks with a tradeoff of 
0{\) in delay guarantees. The algorithm aims to solve a joint 
congestion control, routing, and scheduling problem in a multi- 
hop wireless network while satisfying per-flow average end-to- 
end delay guarantees and minimum data rate requirements. 
This problem has been solved for both backlogged as well as 
arbitrary arrival rate systems. Moreover, we discuss the design 
of a class of low-complexity suboptimal algorithms, effects of 
delayed feedback on the optimal algorithm, and extensions of 
the proposed algorithm to different interference models with 
arbitrary link capacities. 

I. Introduction 

Cross-layer design of congestion control, routing and 
scheduling algorithms with Quality of Service (QoS) guaran- 
tees is one of the most challenging topics in wireless network- 
ing. The back-pressure algorithm first proposed in j l | and its 
extensions have been widely employed in developing through- 
put optimal dynamic resource allocation and scheduling algo- 
rithms for wireless systems. Back-pressure-based scheduling 
algorithms have also been employed in wireless networks 
with time- varying channels (2) (4) . Congestion controllers 
at the transport layer have assisted the cross-layer design of 
scheduling algorithms in |51|6.'|[7|, so that the admitted arrival 
rate is guaranteed to lie within the network capacity region. 
■ Low-complexity distributed algorithms have been proposed in 
O iJTOl dTTl . Algorithms adapted to clustered networks have 
been proposed in lfl2l to reduce the number of queues main- 
tained in the network. However, delay-related investigations 
are not included in these works. 

In this paper, we propose a cross-layer algorithm to achieve 
guaranteed throughput while satisfying network QoS require- 
ments. Specifically, we construct two virtual queues, i.e., a 
virtual queue at transport layer and a virtual delay queue, 
to guarantee average end-to-end delay bounds. Moreover, we 
construct a virtual service queue to guarantee the minimum 
data rate required by individual network flows. Our cross-layer 
design includes a congestion controller for the input rate to the 
virtual queue at transport layer, as well as a joint policy for 
packet admission, routing, and resource scheduling. We show 
that our algorithm can achieve a throughput arbitrarily close 
to the optimal. In addition, the algorithm exhibits a tradeoff of 



O(-) in the delay bound, where e denotes the distance from 
the optimal throughput. 

Our main algorithm is further extended: (1) to a set of 
low-complexity suboptimal algorithms; (2) from a model with 
constantly-backlogged sources to a model with sources of 
arbitrary input rates at transport layer; (3) to an algorithm 
employing delayed queue information; and (4) from a node- 
exclusive model with constant link capacities to a model with 
arbitrary link capacities and interference models over fading 
channels. 

The rest of the paper is organized as follows: Section 
II discusses the related work. In Section III, the network 
model is presented, followed by corresponding approaches for 
the considered multi-hop wireless networks. In Section IV, 
the optimal cross-layer control and scheduling algorithm is 
described, and its performance analyzed. In Section V, we 
provide a class of feasible suboptimal algorithms, consider 
sources with arbitrary arrival rates at transport layer, employ 
delayed queue information in the scheduling algorithm, and 
extend the model to arbitrary link capacities and interference 
models over fading channels. We present numerical results in 
Section VI. Finally, we conclude our work in Section VII. 

II. Related Work 

Delay issues in single-hop wireless networks have been 
addressed in (131 - I21) . Especially, the scheduling algorithm in 
lfl8ll provides a throughput-utility that is inversely proportional 
to the delay guarantee. Authors of lfl9) have obtained delay 
bounds for two classes of scheduling policies. A random 
access algorithm is proposed in 120) for lattice and torus 
interference graphs, which is shown to achieve order-optimal 
delay in a distributed manner with optimal throughput. But 
these works are not readily extendable to multi-hop wireless 
networks, where additional arrivals from neighboring nodes 
and routing must be considered. Delay analysis for multi- 
hop networks with fixed-routing is provided in (22) ■ Delay- 
related scheduling in multi-hop wireless networks have been 
proposed in (23) (24) (25) (26l lf27l . However, none of the above- 
mentioned works provide explicit end-to-end delay guarantees. 

There are several works aiming to address end-to-end 
delay or buffer occupancy guarantees in multi-hop wireless 
networks. Worst-case delay is guaranteed in (28) with a 
packet dropping mechanism. However, dropped packets are 
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not compensated or retransmitted with the algorithm of |28l , 
which may lead to restrictions in its practical implementations. 
A low-complexity cross-layer fixed-routing algorithm is de- 
veloped in [29] to guarantee order-optimal average end-to-end 
delay, but only for half of the capacity region. A scheduling 
algorithm for finite-buffer multi-hop wireless networks with 
fixed routing is proposed in [30] and is extended to adaptive- 
routing with congestion controller in BTI . Specifically, the 
algorithm in BP guarantees (9(i)-scaling in buffer size with 
a e-loss in throughput-utility, but this is achieved at the expense 
of the buffer occupancy of the source nodes, where an infinite 
buffer size in the network layer is assumed in each source 
node. This leads to large average end-to-end delay since the 
network stability is achieved based on queue backlogs at these 
source nodes. 

Compared to the above works, the algorithm presented in 
this paper develops and incorporates novel virtual queue struc- 
tures. Different from traditional back-pressure-based algo- 
rithms, where the network stability is achieved at the expense 
of large packet queue backlogs, in our algorithm, "the burden" 
of actual packet queue backlogs is shared by our proposed 
virtual queues, in an attempt to guarantee specific delay per- 
formances. Specifically, we design a congestion controller for 
a virtual input rate and assign weights in the scheduling policy 
as a product of actual packet queue backlog and the weighted 
backlog of a designed virtual queue, which will be introduced 
in detail in Section IV. As such, the network stabilization is 
achieved with the help of virtual queue structures that do not 
contribute to delay in the network. Since all packet queues 
in the network, including those in source nodes, have finite 
sizes, all average end-to-end delays are bounded independent 
of length or multiplicity of paths. 

III. Network Model 
A. Network Elements 

We consider a time-slotted multi-hop wireless network 
consisting of N nodes and K flows. Denote by (to, n) G C a 
link from node m to node n, where L is the set of directed 
links in the network. Denoting the set of flows by J- and 
the set of nodes by Af, we formulate the network topology 
G = (Af, C). Note that we consider adaptive routing scenario, 
i.e., the routes of each flow are not determined a priori, which 
is more general than fixed-routing scenario. In addition, we 
denote the source node and the destination node of a flow 
c 6 T as b(c) and d(c), respectively. 

We assume that the source node for flow c is always 
backlogged at the transport layer. Let the scheduling parameter 
Pmn(t) denote the link rate assignment of flow c for link 
(to, n) at time slot t according to scheduling decisions and 
let A*s( c )6( c )(i) denote the admitted rate of flow c from the 
transport layer of flow to the source node, where s(c) denotes 
the source at the transport layer of flow c. It is clear that 
in any time slot t, p c s ^ n {t) = Vn ^ 6(c). For simplicity 
of analysis, we assume only one packet can be transmitted 
over a link in one slot, so (^ n (<)) takes values in {0,1} 



V(m,n) 6 C We also assume that Ms( c )b(c)W * s bounded 
above by a constant pm > 1: 

0<^ (c)6(c) (t)<MM, Vce (1) 

i.e., a source node can receive at most \im packets from the 
transport layer in any time slot. To simplify the analysis, 
we prevent looping back to the source, i.e., we impose the 
following constraints 

mEAT 

We employ the node-exclusive model in our analysis, i.e., each 
node can communicate with at most one other node in a time 
slot. Note that our model is extended to arbitrary interference 
models with arbitrary link capacities and fading channels in 
Section V.D. 

We now specify the QoS requirements associated with 
each flow. The network imposes an average end-to-end delay 
threshold p c for each flow c. The end-to-end delay period 
of a packet starts when the packet is admitted to the source 
node from the transport layer and ends when it reaches its 
destination. Note that the delay threshold is a time-averaged 
upper-bound, not a deterministic one. In addition, each flow c 
requires a minimum data rate of a c packets per time slot. 

B. Network Constraints and Approaches 

For convenience of analysis, we define C c = C U 
{(s(c), b(c))}, where the pair (s(c), 6(c)) can be considered as 
a virtual link from transport layer to the source node. We now 
model queue dynamics and network constraints in the multi- 
hop network. Let U^(t) be the backlog of the total amount 
of flow c packets waiting for transmission at node n. For a 
flow c, if n = d(c) then U,^(t) = V<; Otherwise, the queue 
dynamics is as follows: 

E£(t + 1) <[[£(*)- E fnM + 

+ E ifneJVV(c), 

j:(j,n)£C c - 

where the operator [x] + is defined as [x] + ~ max{cc,0}. 
Note that in (01, we ensure that the actual number of packets 
transmitted for flow c from node n does not exceed its 
queue backlog, since a feasible scheduling algorithm may 
not depend on the information on queue backlogs. The terms 

£*(n,<)e£ and X^o.„)e£c^ c „W represent, respec- 

tively, the scheduled departure rate from node n and the 
scheduled arrival rate into node n by the scheduling algorithm 
with respect to flow c. Note that OJ is an inequality since the 
arrival rates from neighbor nodes may be less than J^j Hjn (*) 
if some neighbor node does not have sufficient number of 
packets to transmit. Since we employ the node-exclusive 
model, we have 

^ Et E E < 1, Vn G Af. (4) 

cEF i:(n,i)£C j:(j,n)EC 
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From ([T])(|2]i, we also have 

Vjn(t) < Vm, if n = b(c), (5) 

if it is ensured that no packets will be looped back to the 
source. 

Now we construct three kinds of virtual queues, namely, 
virtual queue U£, c -> (t) at transport layer, virtual service queue 
Z c (i) at sources, and virtual delay queue X c (t), to later assist 
the development of our algorithm: 

(1) For each flow c at transport layer, we construct a virtual 
queue U^,Jt) which will be employed in the algorithm 
proposed in the next section. We denote the virtual input rate 
to the queue as R c (t) at the end of time slot t and we upper- 
bound R c (t) by hm- Let r c denote the time-average of R c (t). 
We update the virtual queue as follows: 

U c s[c) {t + 1) = [U c s{c) (t) - » c sic)b(c) (t)} + + R c (t), (6) 

where the initial U°^(0) = 0. Considering the admitted rate 
Ms( c )6(c)(*) as tne service rate, if the virtual queue U^^ft) 
is stable, then the time-average admitted rate p c of flow c 
satisfies: 

1 *-l 1 *-! 

fi c = lim - V / Us( c )6(c)( T ) > r c= lim - V R c (t). (7) 

(2) To satisfy the minimum data rate constraints, we construct 
a virtual queue Z c (t) associated with flow c as follows: 



Z c (t + l) = [Z c (t)-R c (t)] + + a c , 



(8) 



where the initial Z c (0) = 0. Considering a c as the arrival rate 
and R c (t) as the service rate, if queue Z c {t) is stable, we have: 
r c > a c . Additionally, if U^ c ^(t) is stable, then according to 
(O, the minimum data rate for flow c is achieved. 
(3) To satisfy the end-to-end delay constraints, we construct 
a virtual delay queue X c (t) for any given flow c as follows: 

X c (t+1) = [X c (t) - Pc R c (t)}+ + u n(t) (9) 

neN 

where the initial X c (0) = 0. Considering the packets kept 
in the network in time slot t, i.e., YlneAf ^n(*)> as tne arrrva l 
rate and p c R c {t) as the service rate, and according to queueing 
theory, if queue X c (t) is stable, we have 



r=0 



Furthermore, if U^ c) (t) is stable, then according to (0, we 



have: 



1 



1 



A m 7EE^n(T)<Pc (10) 

In addition, by Little's Theorem, ( TTOb ensures that the average 
end-to-end delay of flow c is less than or equal to the threshold 
p c with probability (w.p.) 1. 

From the above description, we know that the network 
is stable (i.e., each queue at all nodes is stable) and the 



average end-to-end delay constraint and minimum data rate 
requirement are achieved if queues (t) and the three virtual 
queues are stable for any node and flow, i.e., 

1 

limsup- ^2e{X c (t)} < oo, Vc; 



t-i 

limsup -^E{[/^(r)} < oo, 

T = 

t-1 



Vn G 7VU {s(c) :c£j}; 



limsup - E{Z c (t)} < oo, Vc. 

Now we define the capacity region of the considered multi- 
hop network. An arrival rate vector (z c ) is called admissible 
if there exists some scheduling algorithm (without congestion 
control) under which the node queue backlogs (not including 
virtual queues) are stable. We denote A to be the capacity 
region consisting of all admissible (z c ), i.e., A consists of 
all feasible rates stabilizable by some scheduling algorithm 
without considering QoS requirements (i.e., delay constraints 
and minimum data rate constraints). To assist the analysis in 
the following sections, we let (r* c ) denote the solutions to the 
following optimization problem: 

max } r c 

s.t. r c > a c , Vc e J ' . 

where e is a positive number which can be chosen arbitrarily 
small. For simplicity of analysis, we assume that (a c ) is in the 
interior of A and without loss of generality, we assume that 
there exists e' > such that r* c > a c + e' Vc G T. According 
to 1321 . we have 



j™ E r *.c = E r o' 



where (r*) is the solution to the following optimization: 

max > r c 

s.t. r c > a Cl Vc G T . 

IV. Control Scheduling Algorithm for Multi-Hop 
Wireless Networks 

Now we propose a control and scheduling algorithm ALG 
for the introduced multi-hop model so that ALG stabilizes 
the network and satisfies the delay constraint and minimum 
data rate constraint. Given e, the proposed ALG can achieve 
a throughput arbitrarily close to J2 c eJ r ' r *c> under certain 
conditions related to delay constraints which will be later given 
in Theorem 1. 

The optimal algorithm ALG consists of two parts: a conges- 
tion controller of R c (t), and a joint packet admission, routing 
and scheduling policy. We propose and analyze the algorithm 
in the following subsections. 
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A. Algorithm Description and Analysis 

Let qui > Mm be a control parameter for queue length. 
We first propose a congestion controller for the input rate of 
virtual queues at transport layer: 

1) Congestion Controller of R c (t): 



min R c (t)( 

0<-Rc(t)<A*M 



(<?M ~ VM)U c s(c) {t) 



QM 



-X c (t)Pc-Z c (t)-V) 
(11) 

where V > is a control parameter. Specifically, when 
m^MUc^t) _ Xci t )pc - Zc (t)~V > 0, R c (t) is set 
to zero; Otherwise, R c (t) = p,M- 

After performing the congestion control, we perform the 
following joint policy for packet admission, routing and 
scheduling (abbreviated as scheduling policy): 

2) Scheduling Policy: In each time slot, with the constraints 
of the underlying interference model as described in Section 
III including (Q~|i(|2]i(|4]i, the network solves the following opti- 
mization problem: 



(12) 



s.t. 



AC(*) = Vc^CJt), V(m,n)e£ c 
f&n(*) = if " = s (c), Vc G J 7 , 



where c* m (t) and w mn (t) are defined as follows: 
(4nW = arg max u£m(i), 
w mn (<) = [maxu;^ ln (t)] + , 

with weight assignment as follows 

f ^wW 



0, 



if (m,n)e A 



if (m,n) = (s(c),6(c)), 
otherwise. 



(13) 



In addition, when w mn (t) = 0, without loss of optimality, we 
set Mmn(*) = Vc e J 7 to maximize (fTZb . 

Note that C U {(s(c), 6(c)) : c G J 7 } forms the (m, n) pairs 
in (MmnW) over which the optimization ( flZb is performed. 
Thus, the optimization is a typical Maximum Weight Matching 
(MWM) problem. We first decouple flow scheduling from the 
MWM. Specifically, for each pair (m, n), the flow canity i s 
fixed as the candidate for transmission. We then assign the 
weight as w mn (t). Note also that although similar product 
form of the weight assignment (fT~3T > have been utilized in 
[30 1 1 31], no virtual queues are involved there. Whereas in 
ALG, we assign weights as a product of weighted virtual queue 



backlog ( 



c/ 3 c (c )(«) 



) and the actual back-pressure, in an aim to 



shift the burden of the actual queue backlog to the virtual 
backlog. 



To analyze the performance of the algorithm, we first 
introduce the following proposition. 

Proposition 1: Employing ALG, each queue backlog in the 
network has a deterministic worst-case bound: 

K{t)<q M , Vi, Vn G A/", Vc G T. (14) 

Proof: We use mathematical induction on time slot in the 
proof. When t = 0, U°(0) = < qn Vn, c. In the induction 
hypothesis, we suppose in time slot t we have U^(t) < qM 
Vn, c. In the induction step, for any given n G Af and c G F, 
we consider two cases as follows: 

(1) We first consider the case when n = 6(c), i.e., when n 
is the source node of flow c. Since U„(t) < qm from the 
induction hypothesis, we further consider two subcases: 

• In the first subcase, Uu c \{t) < qM — ^M- Then according 
to the queue dynamics Ql and the inequality (0, Ug,^ (t+ 

i) < u c b(c) {t) + m <q M \ 

* In the second subcase, qm — Mm < U§( c ) (t) < Qm- 
According to the weight assignment (fl3l . we have 



s(eWc 



(t) < which leads to fi 



s(c)b(c) 



(t) = 0. Hence, 

Ufefi + 1) < U- (c) (t) < q M by m& 
(2) In the second case, n ^ 6(c), i.e., n is not the source node 
of flow c. Similar to the first case, we further consider the 
following two subcases: 

• In the first subcase, U%{t) < qM- Then, since we employ 
node-exclusive model, U„(t + 1) < U^(t) + 1 < qM by 
©fill. 

• In the second subcase, U^(t) = qM- According to the 
weight assignment ( fT3l we have w^ ln {t) < Vm : 
(m, n) G C. Now, for any given node m : (m, n) G C, 
we have: 

(i) If c ? c* mn (t), then by ©, /fj*) = 0; 

(ii) Otherwise, c = c* m (i), which induces w mn (t) = 
[w^ nn (t)] + = and by the scheduling policy, MmnW 

(). 

Hence n c mn {t) = Vm : (m,n) G £, and U°(t + 1) < 
f/^(i) = by the queue dynamics (01. 
The above analysis holds for any given n G Af and c G T. 
Therefore the induction step holds, i.e., U^(t + 1) < qM Vn, c, 
which completes the proof. ■ 
Now we present our main results in Theorem 1. 
Theorem 1: Given that 

Mm and p c > — ^ Vc G J 7 , (15) 



Qm > 



2N - 1 



Mm 



2r 



ALG can achieve a throughput 

1 4-1 

liminf-^^E{i? c (T)}> 



£<c-f, (16) 



where B = \NKq M PM + K qM ~» M ■■' 



Mm + 2^m Scejp 



In addition, ALG ensures that the virtual queues have a 
time-averaged bound: 



limsupi^^E{(7 s c (c) (r)+X c (r) + Z c (r)} < ^, (17) 

*r=0c£F 
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where B' = B + VBr, with Br and 8 constant positive 
numbers given in the next subsection. 

Remark 1 (Network Stability): The inequalities < TT~4T > from 
Proposition 1 and (fTTT i from Theorem 1 indicate that ALG sta- 
bilizes the actual and virtual queues. As an immediate result, 
ALG stabilizes the network and satisfies the average end-to- 
end delay constraint and the minimum data rate requirement. 
In addition, Proposition 1 states that the actual queues are 
deterministically bounded by q^j, which ensures finite buffer 
sizes for all queues in the network, including those in source 
nodes. 

Remark 2 (Optimal Utility and Delay Analysis): Since 
(^s(c)W) aie stable, the inequality (TToT i gives a lower-bound 
on the throughput that ALG can achieve. Given some e > 0, 
since B is independent of V, ( TToT l also ensures that ALG can 
achieve a throughput arbitrarily close to 2~2 c£ jrr* c . When e 
tends to 0, ALG can achieve a throughput arbitrarily close 
to the optimal value 2^2c£j rr * w i tn the tradeoff in queue 
backlog upper-bound q^j and the delay constraints (p c ), both 
of which are lower-bounded by the reciprocal terms of e as 
shown in < fT3T > in Theorem 1. In other words, the average 
end-to-end delay bound is of order O(-). We note that in 
ALG, the control parameter V, which is typically chosen to be 
large, does not affect the actual queue backlog upper-bound 
or the average end-to-end delay bound, but only affects the 
upper-bound of the virtual queue backlogs (shown in (fTTIi). 
In comparison, in the algorithm proposed in J3T|, the authors 
show that the internal buffer size is deterministically bounded 
with order O(-), but at the expense of the buffer occupancy 
at source nodes which is of order 0(V), where V has to 
be large enough for their algorithm to approach J^cer r l c 
This design assumes an infinite buffer size at source nodes and 
typically results in congestion at the source nodes as shown 
in the simulation results in BP . which further induces an 
unguaranteed and large average end-to-end delay. Moreover, 
one can expect that there are no buffer-size guarantees for 
single-hop flows by employing the algorithm in [3T). In 
contrast, in our proposed ALG, we shift "the burden of V" 
from actual queues to virtual queues and ensure that the 
average end-to-end delay constraints are satisfied with finite 
buffer sizes for all actual packet queues. 

Remark 3 (Implementation Issues): To update the virtual 
queue X c (t) and perform the R c (t) congestion controller at 
the transport layer, the queue backlog information of flow 
c is crucial. This information can be collected back to the 
source node by piggy-backing it on ACK from each node. In 
order to account for such delay of queue backlog information, 
the R c {t) congestion controller ( fTTT i of the algorithm can 
employ delayed queue backlog of X c (t). Similarly, delayed 
queue backlog information of U°, c s (t) can be employed at the 
weight assignment dT3l l of the scheduling policy. The modified 
algorithm and its validity are further discussed in Section 
V.C. By employing delayed queue backlog information, we 
can extend the algorithm to distributed implementation in 
much the same way as in |j8l lfTT1 to achieve a fraction 
of the optimal throughput. In order to achieve a through- 



put arbitrarily close to the optimal value with distributed 
implementation, we can employ random access techniques 
1 37] [38 1 in the scheduling policy with fugacities l39l chosen 

as exp{ aUB{c ^ t ^ U ™^ t ' > } for each link (m,n) S C, 

where U^r c \{t) is a local estimate (e.g., delayed information) 
of f^T(c) W an< ^ 01 a P os iti ve weight. It can be shown that the 
distributed algorithm can still achieve an average end-to-end 
delay of order O(-) with the time-scale separation assumption 
|20l 11361 1371 Q A variation of such distributed implementation 
in single-hop networks can be found in our recent work l40l . 
We prove Theorem 1 in the following subsection. 

B. Proof of Theorem 1 

Before we proceed, we present the following lemmas which 
will assist us in proving Theorem 1. 

Lemma 1: For nonnegative numbers Ai, A 2 , A3, Q G R 
such that Q < [A-y - A 2 } + + A 3 , we have Q 2 < A\ + A\ + 
A 2 3 -2A 1 (A 2 -A 3 ). 

The proof of Lemma 1 is trivial and omitted. We will later 
use Lemma 1 to simplify virtual queue dynamics. 

Lemma 2: For any feasible rate vector (6 C ) <E A with 
6 C > a c Vc 6 T, there exists a stationary randomized 
algorithm STAT that stabilizes the network with input rate 
vector (/^f(^)t,(^.)(i)) and scheduling parameters (fi^ TAT (t)) 
independent of queue backlogs, such that the expected admit- 
ted rates are: 

EK(^(*)} = (?c,Vt,Vc6^. 
In addition, Vt, Vn <E N , Vc, the flow constraint is satisfied: 

n E ^ TAT (t)- E ^ TAT wi = o. 

i:{n,i)eL j:(i.ri)e£ c 

Note that it is not necessary for the randomized algorithm 
STAT to satisfy the average end-to-end delay constraints. 
Similar formulations of STAT and their proofs have been given 
in |5) and J6), so we omit the proof of Lemma 2 for brevity. 

Remark 4: According to the STAT algorithm in Lemma 
2, we assign the input rates of the virtual queues at trans- 
port layer as R^ TAT (t) = ^'rjw^ (t) ■ Thus, we also have 
E{i?f TAT (i)} = 9 C . According to the update equation ©, 
it is easy to show that the virtual queues under STAT are 
bounded above by fiM and the time-average of R^ TAT (t) 
satisfies: rf Tj4T = 9 C . Note that (9 C ) can take values as (r* c ) 
or (r* c + e) or (r* c - \e'), where we recall (r* c + e) g A 
and r* c > a c + e' Vc e T. 

To prove Theorem 1, we first let Q(t) = 
m(t)),(U c s(c) (t)),(X c (t)),(Z c (t))) and define the 
Lyapunov function L(Q(t)) as follows: 

mm = kE ^f^%) (t) 2 + e x sr 

CG ce (18) 

+ E Zcitf + E E — Un(t) 2 U C s(c) (*)}. 

1 Note that the random access works cited above either do not provide delay 
guarantees or are not readily extended to multi-hop settings. 
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It is obvious that L(Q(0)) = 0. We denote the Lyapunov drift From the virtual queue dynamics (O, we have: 

b y i 2 2 

A(t)=E{Z(Q(t+l))-L(Q(t))|Q(t)}. (19) 2^ (Xc(< + 1) " 



From the queue dynamics (O©, we have: 2 



1 , -2X c (t)(p c R c (t)-Y,K(t))) (23) 



EE- ^(t+i) 2 ^ (c) (^ + i) 

c£j r n£A/' 1 9 v— v o 1 , T o o 

„ 1 _ %AE^+0 M «A 



qM n£j\f 



- X c {t) Pc R c {t) + Nq M J2 X ^)- 
<^ MqM NK + Y^—U c s[c) (t)Y^{Un(tf (20) ^ 



( E M™W) 2 + ( E ^n^Y 
i:(n,i)eC j:(j,n)eC 



From the virtual queue dynamics ([HJ, we have: 

i^(Z c (t + l) 2 -Z c (t) 2 ) 

cGJF 

<^ E(^W 2 + a ? - 2Zc(t)(R c (t) - o c )) (24) 



2 



where we recall that JZ^f) < /x M and we employ Lemma 1 < 1 , + Iy (1 2_'T Z c (i)i? c (i) + V a c Z c (t). 
to deduce the second inequality. 2 2^ c ^ cW cU ^ w 

From (l20i i. we have 



Substituting (EB<|22]|(|23]|(|24]| into the Lyapunov drift (O and 
I -i subtracting V ^2 .K{R c (i)\Q(i)} from both sides, we then 

? (E E — TO* + l) a ^(c)(* + l) have: 



A(i)-7^E{flc(t)|Q(t)} 



CG.F 



— + -NKq Mm <B + EW)(" 

UZWZ (c) (t) -X c (t) Pc -Z c (t)-V)\Q(t)} 

ceTne* qM +Nq AI Y,Xc{t) + Y, a c z c(t) 

( X! ^w- E ^w), ce ^ c f 

y.{n,j)ec i:(i, n )ec 1 ( 2Ar_1 +%)^s( c )W (25) 

+ ^m 
where we employ the fact deduced from dUi© that _ „ 

Ei/CW < 1 and Ev^„(*) < 1 when „ ^ 6(c) and -E{ „, E ^%)( f )^(c)b(c) W 



Ej MjnW — A 4 ^ when n = 6(c). Note that we use the qM c ^ 

summation index % and j interchangeably for convenience of w)^(c)w 



analysis. 

From the queue length dynamics (|6]i and by employing 
Lemma 1, we have: ( E ^nj(t) ~ E Mi re (*))lQ(*)}- 



j:(n,j)£C i:(i,n)G£ c 



1 9m A*m ^ _j_ ^2 _ jj C /^2> We can rewrite the last term of RHS of (|25]l by simple algebra 

2 ^-t 9m s(c - ) as 

~2^ (c) (t)(^ (c)b(c) (t)-i? c (t))) (22) (t) (2< 

.^qu-^M 2 +E^(c)6(c)(*)— (9M-MM-t/ 6 C (c)(*))lQ(*)}- 

S-fv Unr _^ <7M 



<7Af 



qM Mm ^ ^(^c — R c (t)). Then, the second term and the last term of the RHS of 

9m c6 ^_ (|25] > are minimized by the congestion controller ( fTTT i and the 



7 



scheduling policy ( TTZI ). respectively, over a set of feasible al- 
gorithms including the stationary randomized algorithm STAT 
introduced in Lemma 2 and Remark 4. We can substitute 
into the second term of RHS of $25[ a stationary randomized 
algorithm with admitted arrival rate vector (r* c ) and into the 
last term with a stationary randomized algorithm with admitted 
arrival rate vector (r* c + e). Thus, we have: 



A(t)-vj2nRc(t)m)} 

<B-V^ 



cGJF 
' * 



C6.F 



E 



(e(q M - Mm) - 



27V- 1 



Mm • 



(27) 



]T« C - a c )Z c (t) - J2(Pc<c - Nq M )X c {t). 



When (fT3T > holds, we can find e\ > such that e\ < p 



e(?m- /*m)— - 



9m 



Recall that e' 



iVgM Vc G J 7 and ei < 

is defined such that r* c > a c + e' Vc G J 7 . Thus, we have: 
A(t)-V^{Rc(t)\Q(t)} 



<B - 6j2(Xc(t) + U c s(c) it) + Z c (t)) <,„ 



(28) 



where 5 = min{ei, e'}. 

We take the expectation with respect to the distribution of 
Q on both sides of (f28b and take the time average on r = 
0, t — 1, which leads to 



lE{L(Q(t))}-^^E{ J R c (r)} 
<B-Vj2<c 



r=0c£j r 



t-i 



- 7 E E e ™ t ) + + z ^))- 



r=Q c^T 



Since limsup^^ | 2~^t=o S c E{i? c (7")} is bounded above 
(say, by a constant Br with £?r < K/im) and E{L(Q(i))} is 
nonnegative, by taking limsup of t on both sides of d29l . we 
have: 

1 

limsup - E E ™ T ) + C/ S %)( r ) + ^ r )} 



t=0 c£F 



(30) 



<- 



(5 5 
B' 



e<E.F 



which proves (1 17V 



By taking liminf of i on both sides of d29V we have 



£— i-oo t ^ » ^ ' 



r=0 cGJ 7 

^1 u ss f 7 E E E ^( r ) + ^ c ( C )( t ) + z ^ (31) 



t=o ce.F 



7 + E<c 



which proves ( TTol l since the first term of the RHS of (l3~TT l is 
nonnegative. 

V. Further Discussions 

A. Suboptimal Algorithms 

Solving MWM optimization problem can be NP-hard de- 
pending on the underlying interference model as indicated 
in J33). In this section, we introduce a group of suboptimal 
algorithms that aim to achieve at least a 7 fraction of the 
optimal throughput. We denote the scheduling parameters of 
suboptimal algorithms by (A t mn C/S (^))- F° r convenience, we 
also denote the scheduling parameters of ALG by (^^ PT (t)). 
Algorithms are called suboptimal if the scheduling parameters 
(p^n UB (t)) satisfy the following: 



f_jHmn" "" \t)w mn (t) > 7y^^mn" (t) '° Pr (t)w mn (t), 
m,n m,n 

(32) 

where 7 G (0,1) is constant and we recall that c£j„(i) and 
w mn (t) are defined in Section IV. A. In addition, the congestion 
controller of suboptimal algorithms is the same as that of ALG 

CD. 

Following the same analysis of ALG, Proposition 1 holds for 
suboptimal algorithms, i.e., the queue backlogs are bounded 
above by qM, and we derive the following theorem: 

Theorem 2: Given that 

2N-1 + p? M 



(29) q M > 



275 



1 ^ Nq M w c _ 
fj, M and p c > — — Vc G F, 

Tic 33) 



3e 2 > s.t. 7r* c > a c + e 2 Vc G J", 



a suboptimal algorithm ensures that the virtual queues have a 
time-averaged bound: 



lim sup — 1 

r=0 cE T 



B 



1{U: (c) (t)+X c (t) + Z c (t)}<-, (34) 



where B = B + jVBr. In addition, a suboptimal algorithm 
can achieve a throughput 



t=0cG.F 



B 
V' 



(35) 



Proof: The proof is provided in Appendix A. ■ 
Remark 5: From Theorem 2, given an arbitrarily small e, 
we show that a suboptimal algorithm can at least achieve 
a throughput arbitrarily close to a fraction 7 of the optimal 



g 



Suboptimal algorithms include the well- 



results £ e&F r* c . 

known Greedy Maximal Matching (GMM) algorithm 
with 7 = | as well as the solutions to the maximum 
weighted independent set (MWIS) optimization problem such 
as GWMAX and GWMIN proposed in J35) with 7 = ^, 
where A is the maximum degree of the network topology G. 
The delay bound and throughput tradeoff in Theorem 1 still 
hold in Theorem 2. 

B. Arbitrary Arrival Rates at Transport Layer 

Note that in the previous model description, we assumed 
that the flow sources are constantly backlogged, that is, the 
congestion controller dTTb can always guarantee R c (t) = pm 
when m^MU c s{c) {t) - X c (t)p c - Z c (t) - V < 0. In this 
subsection, we present an optimal algorithm when the flows 
have arbitrary arrival rates at the transport layer. 

Let A c (t) denote the arrival rate of flow c packets at 
the beginning of the time slot t at the transport layer. We 
assume that A c {t) is i.i.d. with respect to t with mean A c . For 
simplicity of analysis, we assume (A c ) to be in the exterior of 
the capacity region A so that a congestion controller is needed 
and we assume that A c (t) is bounded above by pm Vc G 
Let L c {t) denote the backlog of flow c data at the transport 
layer which is updated as follows: 

L c (t + 1) = min{ [L c (t) + A c (t) - ^ (c)6(c) (t)]+,L M }, (36) 

where Lm > is the buffer size for flow c at the transport 
layer. Note that we have Lm = and L c (t) = if there is 
no buffer for flow c at the transport layer. 

Following the idea introduced in 0, we construct a virtual 
queue Y c (t) and an auxiliary variable v c (t) for each virtual 
input rate R c (t), with queue dynamics for Y c (t) as follows 



Y c (t + 1) = [Y c (t) - R c {t)}+ + v c (t), 



(37) 



where initially we have Y c (0) = 0. The intuition is that v c {t) 
serves as the function of R c {i) in congestion controller (fTTT i 
and we note that when Y c {t) is stable, we have r c > v c , where 
v c is the time average rate for v c (t), recalling that r c is the 
time average rate for R c (t). Thus, when Y c (t) and U°^(i) are 
stable, if we can ensure the value £ v c is arbitrarily close 
to the optimal value £ c r* c , then so is the throughput £ c p c 
since p c > r c > v c . 

Now we provide the optimal algorithm for arbitrary arrival 
rates at the transport layer: 

1) Congestion Controller: 



min RAt){ 

Ra(t) 

s.t. 



min v c (t)(r]Y c (t) 

0<»c(<)<W.( 



QM — (J>M jj C i,\ v t,\ 

< R c (t) < min{i c (t) 



n 



(38) 



0, v c {t) is set to zero; 



is set 



' s (c)< 

to zero; 



Otherwise, 



Specifically, when rfY c {t) — V > 
Otherwise, v c (t) = When 
X c (t)p c - Z c (t) > 0, R c (t) 

R c {t) = mm{L c (t) + M*), Mm}- 

2) Scheduling Policy: The scheduling algorithm is the same 
as that of ALG provided in Section IV.B, except for the up- 
dated constraints: < A^( c )5( c ) (t) < mm{L c (t)+A c (t), hm}- 

Since the scheduling policy is not changed, Proposition 1 
still holds. And we present a theorem below for the perfor- 
mance of the algorithm: 

Theorem 3: Given that 



2JV- 1 



Mm 



2c- 



+ hm and p c > 



Nq M 



VceJ, 



the algorithm ensures that the virtual queues have a time- 
averaged bound: 

1 B 

li m sup-^^E{C/ s c (c) (r)+A c (r)+Z c (r)+r c (r)} < * 

t— too I 

where B2 = B + Kr\p? M + VBr and 8' is constant positive 
number. In addition, the algorithm can achieve a throughput 



t— too t 



Bi 
V 



where B\ = B + Krip 2 M . 

Proof: The proof is provided in Appendix B. ■ 
Theorem 3 shows that optimality is preserved and O(-) 
delay scaling is kept. 

C. Employing Delayed Queue Backlog Information 

Recall that in ALG, congestion controller (fTTT i is performed 
at the transport layer and link weight assignment in (fT3l l is 
performed locally at each link. Thus, in order to account for the 
propagation delay of queue information, we employ delayed 
queue backlog of (X c {t)) in (fTTT i and employ delayed queue 
backlog of {Ugt c \{t)) f° r links in C in ( fT3l . Specifically, we 
rewrite ffTTT > in ALG as: 

mmR c (t)( ^ X&- T) Pc - Z c (t) - V), 

qM 

(40) 

where T is an integer number that is larger than the maximum 
propagation delay from a source to a node, and we rewrite (fT3l i 
as: 



X c (t)p c - Z c (t)) (39) 
A c (t),p, M } 



M 



U c s{c) {t-T) 



qM 



0. 



[q 



[uut)-u c n {t)\, 

if (m, n) G C, 



M — fJ-M 



6(c) (*)]) 

if (m,n) = (s(c),6(c)), 
otherwise. 



(41) 



where 77 > is a weight associated with the virtual queue 
Y c (t). Note that ( f38T> and ( [39l can be solved independently. 

2 Note that our analysis also works for the case when A c (t) is bounded 
above by some constant Am Vc £ T, where Am > fJ-M- 



Proposition 1 still holds and we present a theorem for the 
scheduling algorithm using delayed queue backlog informa- 
tion, which maintains the throughput optimality and O(-) 
scaling in delay bound: 
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Theorem 4: Given that 

2N-1 + p 2 M 



qM > 



2e 



, ^ Nq M 
Hm and p c > — - — Vc e J- , 



the algorithm ensures that the virtual queues have a time- 
averaged bound: 

limsup - J2 E E {^(c) M + X c (r) + Z c (r)} < ^, 



t=0 cG.F 



where B 4 = B 3 + and B 3 = B + KNp, M T + 

NqjuTfiMPc + Kp1n 2 M T. In addition, the algorithm can 
achieve a throughput 



"^EE^^E^ 



CG.F 



V 



Proof: The proof is provided in Appendix C. ■ 
On employing delayed queue backlogs, we can extend the 
centralized optimization problem (Y2\ to distributed implemen- 
tations with methods introduced in Remark 3. 

D. Arbitrary Link Capacities and Arbitrary Interference Mod- 
els with Fading Channels 

Recall that in the model description in Section III, the link 
capacity is assumed constant (one packet per slot) and node- 
exclusive model is employed. In this subsection, we extend the 
model to arbitrary link capacities and arbitrary interference 
models with fading channels of finite channel states. Thus, 
instead of ©, we have (i))(m.n)e£ £ ^(*)> where I{t) 
is the feasible activation set for time slot t determined by the 
underlying interference model and current channel states, with 
link capacity constraints X^ce.F Mmn(*) — ^™»> wnere Imn is 
the arbitrarily chosen link capacity for a link (m, n) € C. 
We define l n 4 max (Ai; _ (t))e/(t) £ c&F £ m:(m>T0€jC /&,»(*). 
Note that it is clear that /„ < J2m:( m ,n)GC l mn- Then we 
can update the optimization (fT2b and weight assignment ( fT3l . 
respectively, as follows: 

max V~ * (t)w mn (t) 

mn rn,n 

S - L (Mmn(*))(m,n)e£ G ^(*) and Hs( c )b(c)(t) < fJ-M Vc G £. 



.(<) 



QM 



0, 



ra*)-E£(*)-*n]. if (m,n)e £, 



if (m,n) = (s(c),6(c)), 
otherwise. 



It is not difficult to check that Proposition 1 still holds 
with qj^ > niaxjniaxngjv Z n , /^a/} and Theorem 1 holds 
with a different definition of constant B. The above modified 
algorithm can be further extended to solve power allocation 
problems, where we refer interested readers to our recent work 

ED. 




Fig. 1. Network topology for simulations 



VI. Numerical Results 

In this section, we present the simulation results for the 
proposed optimal algorithm ALG. Simulations are run in 
Matlab 2009A with results averaged over 10 5 time slots. In 
the network topology illustrated in Figure Q] there are three 
source-destination pairs (A, G), (D, E) and (F, H) with same 
Poisson arrival rates and /j,m = 2. The required minimum data 
rate for the three flows are all set to 0.1. We denote by BP the 
back-pressure scheduling algorithm in [ 1 ] with a congestion 
controller in 15), and denote by Finite Buffer the cross-layer 
algorithm developed in QT) with buffer size equal to the queue 
length limit q^j. Note that it is shown in simulation results in 
||3T1 that Finite Buffer algorithm ensures much smaller internal 
queue length (of nodes excluding the source node) than BP 
algorithm (and queue length is related to delay performance). 
We set the control parameter V = 1000, where in simulations 
we find that a higher V cannot further improve the throughput. 

We first illustrate in Table |T] the throughput optimality of 
ALG when the sources are constantly backlogged. We loosen 
the delay constraint as p c = SOqm- As we increase the control 
parameter qM, the ALG achieves a throughput approaching the 
throughput of BP algorithm which is known to be optimal. We 
also note that this approximation in throughput results in worse 
average end-to-end delay performance, which complies with 
Remark 1. 

We then illustrate the throughput and delay tradeoff for both 
the ALG and its corresponding suboptimal GMM algorithm in 
Figure|2]for the case of arbitrary arrival rates at transport layer 
with Lm = 0, where we set qM = 5 and p c = 50 for each flow 
c. Note that this pair of qM and p c shows that the bound in 
(fT~5T > is actually quite loose, and thus our algorithm can achieve 
better delay performance than stated in (fT5l l. Figure [2] shows 
that the average end-to-end delay under ALG is well below 
the constraint (p c = 50) and lower than that under BP and 
Finite Buffer algorithms. The throughput of ALG is close to 
(although lower than) that of the optimal BP algorithm when 
arrival rates are small (< 0.3). Specifically, when the arrival 
rate is 0.3, ALG achieves a throughput 10% more than the 
GMM algorithm and 9.0% less than BP algorithm, with an 
average end-to-end delay 35.2% less than the BP algorithm. 
In the large-input-rate-region (> 0.3), we also observe that the 
delay in both the BP and Finite Buffer algorithm violates the 
delay constraints. In addition, in the above illustrated scenarios 
with backlogged and arbitrary arrival rates, the minimum 
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TABLE I 

Throughput performance of ALG when sources are backlogged at the transport layer 





ALG (p c = 150) 


ALG (p c = 300) 


ALG (p c = 3000) 


ALG (p c = 30000) 


BP 


Throughput (sum for three flows) 


0.9368 


1.1834 


1.2007 


1.2305 


1.2315 


End-to-end delay (averaged over three flows) 


45.76 


131.47 


1.514 x 10 3 


1.3687 x 10 4 


3.753 x 10 4 



arrival rates and average end-to-end delay requirements are 
satisfied for individual flows under ALG. As a side note, the 
average end-to-end delay in all four algorithms in Figure [2] 
first decreases, which can be explained by the intuition that all 
the algorithms are based on back-pressure of links (i.e., queue 
backlog difference of links) and the queue backlog difference 
tends to be larger for each hop with a larger arrival rate. When 
arrival rate further increases, congestion level becomes higher 
since more packets are admitted into the network. 




arrival rate arrival rate 



Fig. 2. Throughput and delay tradeoff under Alg. with performances 
compared to Finite Buffer algorithm and BP algorithm, with varying arrival 
rates at the transport layer. 

VII. Conclusions and Future works 

In this paper, we proposed a cross-layer framework which 
approaches the optimal throughput arbitrarily close for a gen- 
eral multi-hop wireless network. We show a tradeoff between 
the throughput and average end-to-end delay bound while 
satisfying the minimum data rate requirements for individual 
flows. 

Our work aims at a better understanding of the fundamental 
properties and performance limits of QoS-constrained multi- 
hop wireless networks. While we show an O(-) delay bound 
with e-loss in throughput, how small the actual delay can 
become still remains elusive, which is dependent on specific 
network topologies. In our future work, we will investigate the 
capacity region under end-to-end delay constraints applied to 
different network topologies. Our future work will also involve 
power management in the scheduling policies. 
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Appendix A 
Proof of Theorem 2 



Proof: Let A SUB (t) denote the corresponding Lyapunov 
drift of a suboptimal algorithm which takes the same form as 
J19t . By analyzing (|23T>(f26T> which also hold for suboptimal 
algorithms, we note that the second term of RHS of (|25l l is 
always non-positive ensured by the congestion controller ( fTTT i. 
Employing ( l32l to (t25T>(t26l>. we derive the following 



A suB (t)-vj2nRc(t)\Q(t)} 



<S + 7^E{i? c (t)( 



-X c {t) Pc -Z c {t)-V)\Q(t)} 
-Nq M ^X c {t) + ^a c Z c {t) 

1 (2N - I + fiDU^it) 
~2^~ 



(42) 



C6JF 



qM 



- 7 E{ 



qM — Mm 



qM 



E^(o(*K(S?)(*) 



EE 



qM 



(E^r s (*)-E^ £/fl (*))iQ(*)}' 

3 i 

Following the steps in proving d27l ), we have from d42l 

A(t) SUB -Vj2nRc(t)\Q(t)} 

a 

<£-F 7 E<c 



2^ — : — (7<n<7A/ - mm) ^ ) 



(43) 



qM 



- E« C - a ") Z S) ~ E^< c - Nq M )X c (t). 



Employing the conditions (l33l and following the steps in 
proving (130b and (|3T1 i. we can prove Theorem 2. ■ 



Appendix B 
Proof of Theorem 3 

Before we proceed to the proof, we extend the stationary 
randomized algorithm STAT introduced in Lemma 2 and 
Remark 4. Given (8 C ) introduced in Lemma 2 and given 
flow c at node n, recall that (A c (t)) is i.i.d. with mean 
(A c ) and (A c ) > (6 C ) element-wise. The flow control for 
STAT can be given as: Admit Ms'(fwcT(*) = A c (t) w.p. jf-; 
otherwise, fi™${t) = 0. Then (*)} = V*. 



Now take v s c TAT {t) = R s c TAT (t) = ^ s fJ b fJ(t) Vc G T 



3 (c)6(c) 
c,STAT, 



Then we also have E{v^ TAT (t)} = E{R^ AT {t)} = 9 C . 
Note that Rf TAT (t) < A c (t) < min{£ c (<) + A c (t),fi M } 
and v^ TAT (t) < n M . 

Now we present the proof. 

Proof: We define the Lyapunov function as L(Q'(t)) = 

L (Q(t)) + iEce^-^c 2 ^) and the Lyapunov drift as 
A'(t) = E{L(Q'(t + 1)) - L(Q'(t))\Q'(t)}, where Q'(f) = 
(Q(t), (Y c (t))). From the virtual queue dynamics (f37T > and 
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Lemma 1, we have 

^(r c (* + i) 2 -y c (i) 2 ) 



<U2(Rc(t) 2 + v c (tf - 2Y c {t){R c {t) - v c (t))) 



<K W 2 M - vY c (t)(R c (t) - v c {t)). 



Following the steps in deriving 



we have 



A'(t)-vY,nv c (t)\Q'(t)} 
<B X + Y Hv c (t)(vY c (t) - V)\Q'(t)} 



(<?M ~ liM)U c s{c) {t) 



-i]Y c (t)-X c (t) Pc 
+Nq M Y X M + Y acZc ^ 



z c {t)W{t)} 



(2N 



Ai)U c <c) (t) 



qu 



U° (t) 

-E{J2 E 



cGJ 7 (m,n)eC 



2^ ^s(c)6(c) W KQM 



(44) 



Employing the above inequalities to 

A(t)-vYnRc(t)\Q(t)} 

.(qM ~ l*M)U° (c) (t) 



we have 



<B + J2^i R c(t)(- 



qu 



-X c (t-T) Pc -Z c (t)-V)\Q(t)} 
-Nq M Y X c(t) + Y a ^ Z ^ + K PlAi T + \KN mi T 



2 



(2N-l + p\ I )U^ c) (t) 



cE.F 



qM 



- E (E E . T \ v 



cGJ 7 (m,n)GC 



<1M 



(t) s(c 



(t) 



qM 



(q M -p M -U^ c) (t))\Q(t)}. 



(45) 



+ E VMcMc) 

The second term and the last term of the RHS of the above 
inequality are minimized by the congestion controller ( |40b 
and the scheduling policy ( fT2b with weight assignment ( |4"T1 >. 
respectively, over a set of feasible algorithms including the 
stationary randomized algorithm STAT. Substitute into the 
second term of RHS a stationary randomized algorithm with 
admitted arrival rate vector (r* c ) and the last term a station- 
ary randomized algorithm with admitted arrival rate vector 
(r* c + e). Then, employing the inequalities (|46| | and following 
the steps in proving Theorem 1, we can prove Theorem 4. ■ 



»M-Ufa(t))\Q'(t)}, 



The second term, third term and the last term of the RHS 
of (05]) are minimized by the congestion controller ( |381 ). 
d39l > and the scheduling policy dT2b . respectively, over a set 
of feasible algorithms including the stationary randomized 
algorithm STAT. Substitute into the second term of RHS of 
( |45| > a stationary randomized algorithm with admitted arrival 
rate vector (r* c — he'), the third term a stationary randomized 
algorithm with admitted arrival rate vector (r* c ) and the last 
term a stationary randomized algorithm with admitted arrival 
rate vector (r* c + e). Then, following the steps in proving 
Theorem 1, we can prove Theorem 3. ■ 



Appendix C 
Proof of Theorem 4 



Proof: According to queue dynamics ©(O, we obtain 



U c s(c) (t) - m T < U c s(c) (t —T)< U c s(c) (t) + ix M T, 
X c (t) ~ Nq M T < X c (t — T)< X c (t) + PcHmT. 



